Tags › #mixture of experts 1 post
-
Gemma 4 Explained: How One Model Family Spans Phones and Frontier-Class Reasoning
A technical deep-dive into Gemma 4's four core ideas — MatFormer elastic inference, hybrid attention with p-RoPE, parallel dense+MoE FFN, and native agentic tooling — with the Gemma 1–3 lineage as context.